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INTRODUCTION 



This manual is designed to aid the school administrator and staff in the interpretation of 
the assessment report. It gives a condensed version of the history of educational quality assessment 
in Pennsylvania, and although it is not intended to be a technical report, the manual gives some 
general statistical background of Pennsylvania's assessment plan to complement the individual 
report for each participating school. 

In the past the judgment of the quality of a school program has often been determined 
by proxy measures such as the physical plant facilities, the percentage of graduates going to 
college, the number of Merit Scholars and other factors which, although they may suggest the 
quality of the educational product, do not control for differing surrounding conditions and may 
mistakenly or unjustly give the school blame or credit. In short, we have been quick to judge 
but slow to devise adequate criteria for judging. 

To carry out a broader-based plan of educatiofial assessment, people must agree on the goals 

of education, yardsticks by which to measure them, and a means of controlling for the vast 

differences in the resources or "inputs" among schools in ths state-or even within a district. 

In the Commonwealth of Pennsylvania the goals were determined by the State Board of 
Education. Rather than restricting themselves to just basic skills'— the reading, writing, arithmetic 
approach-the goals encompass the affective domain as well, recognizing a broader mission for 
the schools-that of educating the whole child. 

It was decided that the best way to measure the quality of education in a school was to 
assess the product, i.e., the students themselves. Recognizing the unfairness of comparing a 
well-equipped school with experienced, well-paid teachers to its polar opposite, differences in 
resources las many as 44 J were taken into account. 

To interpret a school report, the school personnel must thoroughly acquaint themselves with 
the goals, the dimensions measured on each goal instrument, the condition variables measured 
and the method used plus the form in which these results are reported for each school. It is 

the purpose of this manual to assist in the acquisition of this knowledge. 
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BACKGROUND 



The Pennsylvania plan of assessment had its legal beginning in 1963 with the passage of 

Act 299 which required the State Board of Education to 

develop or cause to be developed an evaluation procedure designed 
to measure objectively the adequacy and efficiency of the 
educational programs offered by the public schools of the 
Commonwealth.... The evaluation procedure shall be so constructed 
and developed as to provide each school district with relevant 
comparative data to enable directors and administrators to more 
readily appraise ti\e educational performance and to effectuate 
without delay the strengthening of the district's educational 
program. 

To carry out these mandates the State Board of Education Committee on Quality Education, 
after conferring with civic and professional leaders from throughout the state, adopted the 
following as the 10 goals of quality education. 



I. Quality education should help every child acquire the greatest possible understanding 
of himself and an appreciation of his worthiness as a member of society. 

II. Quality education should help every child acquire understanding and appreciation of 

persons belonging to social, cultural and ethnic groups different from his own. 

III. Quality education should help every child acquire to the fullest extent possible for 

him, mastery of the basic skills in the use of words and numbers. 

IV. Quality education should help every child acquire a positive attitude toward the teaming 
process. 

V. Quality education should help every child acquire the habits and attitudes associated 
with responsible citizenship. 

VI. Quality education should help every child acquire good health habits and an 
understanding of the conditions necessary for the maintaining of physical and emotional 
well-being. 

VII. Quality education should give every child opportunity and encouragement to be creative 
in one or more fields of endeavor. 

VIII. Quality education should help every child understand the opportunities open to him 
for preparing himself for a productive life and should enable him to take full advantage 
of these opportunities. 

IX. Quality education should help every child to understand and appreciate as much as 
he can of human achievement in the natural sciences, the social sciences, the humanities 
and the arts. 

X. Quality education should help every child to prepare for a world of rapid change and 
unforeseeable demands in which continuing education throughout his adult life should 
be a normal expectation. 
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PHASE I 



In June 1967 the Bureau of Educational Quality assessment was created to translate the 
mandates and the 10 goals into a workable plan of assessment. 

The primary purpose of Phase I was development and field-testing of a measurement package. 
Measurement instruments for the goals were selected in some instances from previously published 
tests. In other areas new tests and questionnaires were developed by EQA Bureau staff in 
cooperation with the Bureau of Research and national testing firms. 

In April 1968 the measurement package was pilot-tested in 100 schools in the Commonwealth. 
The elementary school package was administered to 1413 5th graders and the high school package 
to 1 285 1 1 th graders. 

After the initial field-testing, items from the questionnaire were analyzed, reworded or deleted. 
Testing procedures in the schools were also refined. Table 1 summarizes the characteristics of 
the final assessment instruments. 

Furthermore, surrounding conditions differ-in the home, the school and the community-and 
impose unavoidable constraints on what a school can accomplish with its pupils. Recognizing 
that schools operate within the limits of vastly differing conditions, these differences in programs 
and resources, both teacher and student, had to be identified and measured. Phase I was designed 
to measure relationships among what pupils bring with them, what the community, school and 
staff can offer, and what pupils achieve. 
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TABLE 1 (continued) 

GRADE 5 SUMMARY OF INSTRUMENTS 




PHASE II 



To provide normative standards on a state representative sample, Pennsylvania schools were 
stratified according to building enrollment and the average ptr-pupil expenditure for education 
in the county. The field-tested and refined measur: meht packages [Table 1] were administered 
to students in 5th and 1 1th grades of schools randomly selected within these strata. This normative 
sample from 268 school districts represented 10 per cent of the student population in grades 
5 and 11-20,000 students and 17,000 students, respectively, in 355 elementary and 73 high 
schools. School mean scores, student distributions and item distributions were calculated and norms 
established. 

In each goal area the school mean is calculated by computing the average raw score of 
all 5th grade students in that school who completed the questionnaire or test. These school means 
are then rank ordered [high to low] and then divided into 100 equal parts or percentiles [Table 
2]. Each part has an equal number (one per cent) of the total scores. For example, if a school 
mean score on Self Understanding was 87.64, the school would rank in the 65th percentile-65 
per cent of the schools in the normative sample had lower scores, 35 per cent had higher scores. 

In addition to the items designed to measure pupil performance on the 10 goals, students 
answered questions about their family background, their interests and the accessibility of school 
resources. At the same time teachers anonymously completed a questionnaire [Appendix A] to 
assess their backgrounds, classroom practices and attitudes. Teacher data on file with the Bureau 
of Statistics were tapped. In addition, building administrators replied to a form [Appendix B] 
requesting information about the school and the community it serves. 
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PHASE III 



Phase III, the actual assessment of schools, began in the fall of 1970 with the participation 
of 1 10 school districts selected on a first come, first served basis from the more than 300 districts 
that requested assessment. The overwhelming response has forced the bureau, because of budget 
restraints, to turn away districts every one of the three years Phase III has been in operation. 
The following numbers describe the scope of assessment in Pennsylvania to date: 



School year 


#districts 


#schools 


#students 


1970-71 


110 


533 


50,000 


1971-72 


49 


225 


23,000 


1972-73 


84 


474 


56,000 



Each fall, just as in the normative study [Phase II] in 1969, 5th and 11th grade students 
respond to the items in the Pennsylvania Questionnaires. Since the school-not the district or 
the individual student-is the unit of analysis, students are not identified by name nor are scores 
aggregated by district. The student booklets are machine-read and scored and the information 
aggregated for the school. 

Sample teachers* anonymously respond to a Teacher Questionnaire [Appendix A] designed 
to supply data on their background, classroom practices and attitudes. Building administrators 
complete the School Information Form [Appendix B]. Bureau of Statistics files are tapped. 

Data from these four sources are then merged, compared to the responses of the reference 
group from Phase II and entered into an extremely complex computer program to generate a 
separate report for each participating school. 



*In participating elementary schools all the 5th grade teachers or a minimum of five teachers was 
sampled. 



CONDITION VARIABLES 



Tables 3, 5 and 7 describe the variables which were measured to identify the differences 
in resources among schools. It is extremely important to note both the name of the variable 
and how it was measured (from whom the data were obtained and the weightings used to quantify 
the information). 

"High " scores for a school on these variables are not necessarily "good. " The numbers 
attached to these variables are designed to reflect the presence or absence of the characteristic 
in question or merely to differentiate by quantification one class within the characteristic from 
another. 

One must avoid hasty value judgments regarding a school's standing on a given condition 
variable without being aware of the interrelationships among the variables. When calculating average 
teacher salary, for example, one is also measuring teacher experience, teacher education and 
possibly teacher age. Therefore, a high average salary might at first suggest a high salary schedule 
when, in fact, it might be due to the presence of a large proportion of experienced teachers 
with a large number of years of formal schooling. 

The percentile score associated with the variable gives the participating school's rank compared 
to the Phase II normative schools in 1969*. Final.. >. t 1 figures for districts have been updated 
as noted in Table 3. 

One other caveat worth noting is apparent on the norms charts (Tables 4, 6, 8): When 
using school means, the range of values can at times be very narrow so that a small incremental 
change in the values can translate into large percentile rank changes (e.g., GUIDANCE, 1NTERRAC, 
HOLDING). 



*The only exception is TSALARY where the percentile score is the rank of the school's 
mean teacher salary compared to the other Phase 111 schools participating in 1972. 
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SCHOOL AND COMMUNITY INDICES 



CLASS OF 
CHARACTER- 
ISTIC 


VARIABLE 

NAME 


MEASURE 


WEIGHTING 


i 

1 

INDEX 

DESCRIPTION 


Program 

Resources 


STAFFP 
(Staff: pupil 
ratio) 


The number of personnel who spend 
at least one-half their time in in- 
structional activity was divided by 
the total nonther of students in the 
school. 




A higher value indicates more in- 
structional personnel per pupil. 




BOOKSP 
(Books: pupil 
ratio) 


The number of library books avail- 
able for student checkout was di- 
vided by the total number of pupils 
in the school. 




A higher value indicates more li- 
brary books available for cai.h pupil, i 

! 




INNOVATE 

(School 

Innovation) 


The school administrator reported 
the extent to which his school em- 
ployed 12+ relatively new educa- 
tional practices (e.g. individual 
study, nongraded classes, instruc- 
tional TV). 


5 = Uso regularly 
4 = Use occasionally 
3 = Considered trying 
2 = Don't agree 
1 = Never tried 


A higher score on this index in tit- j 
cates the school uses several inn ova- 1 
live practices regularly and/or many , 
of the practices at least occationally. 


... 


LIBRARY 
(Accessibility 
of library) 


Students were asked how often they 
were able to use the school library. 


5 = Often as needed 
4 = Frequently 
3 = Several days a week 
2 = Only when class is scheduled 
1 = No library in school 


A higher score on this index indi- 
cates that the school offers freer j 
accessibility to its library resources, j 


Financial 
Resource a 


SUBSIDY 
(School subsidy 
per WADM) 


The state instructional subsidy paid 
to the school district was divided by 
the Weighted Average Daily Mem- 
bership of the district. All schools 
participating from district were as- 
signed this score. 


Expressed in whole dollars 
paid in 1971-72 


A higher value indicates that the 
school of interest is in a district 
which received more state funds to 
supplement its instructional activi- 
ties. 




INSEXADM 
(Instructional 
expenses per 
ADM) 


The instructional expenses of the 
distract were divided by the Average 
Daily Membership of the district. 
All schools participating from dis- 
trict were assigned this score. 


Expressed In whole dollars 
paid in 1970*7 1 


A higher value indicates that the 
school of interest is in u district 
which expends relatively more funds 
per pnpil for instruction. 




EFFORT 
(Tax Effort 
Index) 


Bodgetcd school taxes for the dis- 
trict were divided by the market 
values. All schools participating 
from district were assigned this 
score. 


Expressed in mills 
for 1971-72 


A higher valoe indicates that the 
school of interest is in a district 
which has s greater willincucae to 
tax itaelf for educational purposes. 


Demographic 


ENROLL 

(School 

Enrollment) 


The administrator reported the total 
school enrollment as of October 1 
of a given year. 




The number indicates the building 
enrollment. 




LOCATION 
(Predicted 
achievement 
index by 
location) 


Secondary students reported the 
type of commonity in which they 
were then living. 

Due to substantial misinterpretation 
of this item by 5tb grade pupils in 
the normative study, the EQA staff 
assigned scores to elementary 
schools based upon knowledge of 
size and location of the communi- 
ties from which the school drew its 
students. In subsequent school 
studies, elementary pupils were 
aided by the teacher in reporting 
their community type. 


R s Suburb of city (over 500,000) 
7 = Suburb of city (100,000-500,- 
000) 

6 = Suburb of city (104)00-100,000) 
5 = Inside city (10,000-100,000) 

4 = Inside city (1004)00-500,000) 

3 = Inside town less than 10,000 
2 = Inside city over 500,000 
1 = Open country or farming com- 
munity 


A higher score on this index indi- 
cates that the school is drawing a 
larger proportion of its students 
from snborban rather than rural or 
urban areas. 




INTERRAC 

(Interracial 

exposure) 


Students reported whether or not 
they came in contact with students 
of a race different from their own 
in their Hasses or school activities. 


2 = Yes 
1 = No 


A higher value on this index indi- 
cates greater interracial exposure in 
school. 




HOUSING 
(Types of 
residences 
in school's 
community) 


The school administrator reported 
the percentage of various types jf 
housing units in the area served by 
the school. 


6 = Expensive private homes 
5 = High-rental apartments 
4 = Moderate-priced homes 
3 = Moderate-rental apartments 
2 = Low-cost homes 
1 = Low-rental apartments 


A higher value on this index indi- 
cates that the school serves an area 
that haa a relatively larger propor- 
tion of expensive private homes 
and/or apartments. 
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INSTRUCTIONAL STAFF INDICES 



CLASS OF 
CHARACTER- 
ISTIC 


VARIABLE 

NAME 


MEASURE 


WEIGHTING 


INDEX 

DESCRIPTION 




TMEDUC 
( Educational 
le**el of 
teacher's 
mother) 


Sample teachers reported the highest 
level of formal education attained 
by their mother or femalf guardian. 


9 = Completed Ph.D. or profes- 
sional degree 

8 = Some work toward Ph.D. or 
professional degree 
T = Masters degree 
6 = Graduated, college 
5 = Some post-high school 
4 = Graduated, high school 
3 := Some secondary 
2 zz Elementary 
1 = No formal education 


A higher value on this index indi- 
cates that the mothers of the school's 
instructional staff have attained a 
higher level of formal education. 




TFOCC 
(Occupational 
level of 
tearhcr*t 
father) 


The sample teachers reported the 
occupational category of their father 
or principal wage earner while they 
were growing up. 


9 = Professional; doctor, lawyer 
8 = Arcountant, or manager 
7 = Teacher 

6 ^ Owner of small business 
5 = White-collar 
4 = Farmer 
3 = Skilled worker 
2 = Semi-skilled worker 
1 = Unskilled 


A higher value on this index indi- 
cates that the school's instructional 
staff comes from backgrounds in 
which the family's principal wage 
earner tended to be professional or 
white-collar workers as opposed to 
semiskilled or unskilled. 


Background 


'TLOCALE 

(Teacher 

locale) 


Sample teachers reported where they 
graduated from high school. 


5 = This town or immediate area 
4 = In state but outside this town 
3 = In another state 

possession 

1 sz In another country 


A higher value on thix index indi- 
cates that the school draws its in- 
structional staff from the local area 
as opposed to other states or coun- 
tries. 




TCOLLEGE 

(Teacber*« 

college) 


Sample teachers reported whether or 
not they bad earned a college de- 
gree and the type of college from 
which they graduated. 


3 = Liberal arts college or oniver- 
sity 

2 = State college 
1 = No degree 


A higher score on this index indi- 
cates that more of the staff have de- 
grees and are more likely to have 
attended a liberal arts college or 
university than a state college. 




TEDUC* 

(Teacher*! 

education) 


The level of training of all teachers 
was obtained fyom the Professional 
Personnel Record. 


9 = Doctor's degree 
8 = Master's degree pins 2 years 
7 = Master's degree plus 1 year 
6 = Master's degree 
5 = Bachelor's degree plus 1 year 
4 = Bachelor's degree 
3 = Three years of college 
2 = Two years of college 
1 = One year of college 
0 = No college 


A higher score on this index indi- 
cates that the school's instructional 
staff has a higher level of formal 
education. 




TSTABL 
(Teach- r 
stability) 


Sample teachers reported the area 
iff which they spent most of their 
lives. 


Response alternatives and respec- 
tive weightings were identical to 
TLOCALE. 


A higher value on this index indi- 
cates that the school's instructional 
staff have spent most their lives in 
the immediate area as opposed to 
other states or countries. 




TACE 

(Teacher*! !ge) 


Each sample teacher indicated his 
age hy checking one of nine 5-year 
age categories.* 


9 = 60 or over 
8 = 55-59 
7 = 50-54 
6 = 4549 
3 = 4044 

1 = 33-39 

3 30-31 

2 = 25-29 
1 = 20-24 


This index reflects the mean age, by 
categories, of a school's instructional 
staff. 


Demographic 


TSEX* 
(Teacher >ex) 


The sex of each teacher was obtained 
as reported in the Professional Per- 
sonnel Record. 


2 = Female 
1 = Male 


A higher value on this index repre- 
sents a higher proportion of female 
tearhers within the school. 




TEXPER* 

(Teacher 

experienre) 


The total years of service in educa- 
tion was obtained for each teacher 
from the Professional Personnel 
Record. 




This number represents the mean 
educational experience, in years, of 
the school's instructional staff. 



* Collected for off teacher* in. the iehoeL 
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Table 5 (continued) 



INSTRUCTIONAL STAFF INDICES (continued) 



CLASS OF 
CHARACTER. 
ISTIC 


VARIABLE 

NAME 


MEASURE 


WEIGHTING 


INDEX 

DESCRIPTION 


Demographic 


TITOS 

(Teacher present 
position) 


Each sample teacher reported the 
number of years In* had completed 
in his present position. 


F* — 20 «r more years 
T =r I6»20 years 
ft = IMS years 
5 — 6-10 years 
4 = 3*S years 
1—1 years 
2 zz 1 >esir 
1 = Less than 1 year 


This index reflects tin* degree to 
winch a school's instructional staff 
have remained in their present posi- 
tions. 




1 'SALARY* 
(Teurlier salary) 


The salary for each teacher was ob- 
tained from the Professional Per- 
sonnel Record. 




This value represents the mean 
salary for a school's instructional 
staff. 




TSATIS 

(Teacher 

satisfaction) 


Each somple teacher responded to 
a 6*item questionnaire which was 
scaled to reflect the degree of his 
satisfaction with his role in the 
school. 

(Example: **1 find tny job exciting 
and rewarding.”) 


5 = Almost always 
4 *-= Frequently 
3 = Sometimes 
2 = Infrequently 
1 zz Almost never 


A higher value on this index indi- 
cates a greater degree of job satis* 
faction of the school's instructional 
staff. 




Cl.PRACT 

(Teacher 

classroom 

practices) 


Each sample teacher reported the 
extent to which he employed 11 ‘‘in- 
novative” classroom practices (c.g., 
pupil participation iu lesson plan- 
ning). 


5 = Use regularly 
4 zz U?c occasionally 
3 zz Considered its use 
2 = Never use 

t = Don't agree with practice 


The value on this index indicates 
the extent to which relatively in* 
novativc classroom practices are 
employed hy the sample teachers. 




11EACTL 

(Perception 
of actual 
characteristics 
influencing 
professional 
recognition) 


From a list of 7 characteristics, the 
sample teacher chose the one he felt 
was actually most important in gain- 
ing professional recognition in his 
sclioul district. 


7 zz Rapport with central office 
6 zz Rapport with immediate super* 
visor 

5 = Formal education 

4 =r Seniority 

3 r= Imaginativeness 

2 = Dependability 

1 = Quality and quantity of work 


A higher value on this index indi* 
cates that the instructional staff per* 
ceives professional recognition to 
be achieved through personal rela* 
tionsbips as opposed to quality and 
quantity of work completed. 

i 


Altitudinal 


RECIDEA 
(Perception 
of “ideal” 
characteristics 
influencing 
professional 
recognition ) 


From a list of 7 characteristics, 
sample teachers chose the one they 
felt thou Id ideally be most impor- 
tant in gaining professional recog- 
nition in their srhool district. 


Same codes were used r s for 
REACT!.. 


1 

A higher value on this index indi* 
cates that the instructional staff feels 
that ideally professional rerogni* 
tion is obtained through personal 
relationships as opposed to quality 
and quantity of work completed. 




TCAREER 

(Teacher 

carcrr) 


Sample teachers selected from ten 
choices what they would like to be 
doing five years from now. 


10 = Will be retired 

0 = Teacher 

8 = Special services 
7 = Research worker 
6 = Guidance 
5 = Curriculum director 
4 = Principal 

3 — Administrator in central office 
2 Superintendent 

1 = Out of education 


A higher score on this index indi* 
cates that the career aspirations of 
the instructional staff tend toward 
classroom involvement. 




DISCREP 

(Discrepancy) 


Sample teachers rated the relative 
influence 14 groups (superintendent, 
parents, teachers, etc.) bad on the 
educational process. They then 
rated the ideal influence of each of 
those groups. 

For each of the 14 groups a real- 
ideal discrepancy was computed. A 
total discrepancy score was ob- 
tained: 

D = V- d* 


5 = Crest deal 
4 = Considerable 
3 = Some 
2 = Little 
1 = None 


A higher discrepancy score indicates 
o greater disparity between wliat the 
instructional staff sees as the actual 
and the ideal influences various 
groups have in determining educa- 
tional matters in the school. 



* Collected for all teachers in the school. 
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Table 7 

STUDENT INDICES 



CLASS OF 
CHARACTER. 
1STIC. 


VARIABLE 

NAME 


MEASURE 


WEIGHTING 


INDEX 

DESCRIPTION 


* 


FOCC 
< Father’s ^ 
occupation) 


The sample 11th grade student re* 
ported his father’s occupation from 
a list of 143 possible occupations. 
On the elementary level the stn- 
dent's teacher completed thi< item. 


The occupational categories were 
weighted from 0 to 96 according to 
a combination of education needed 
to secure the occupation and income 
derived from the occupation. 


A higher value on this index indi* 
cates that the school tends to draw 
a large proportion of its students 
from homes where the fathers are 
employed in higher-paying jobs re* 
quiring a higher educational level. 


i 


MOCC 
< Mother’s 
occupation) 


The sample 11th grade student re* 
ported his mother's occupation from 
a list of 143 possible occupations. 
On the elementary level the stu- 
dent’s teacher completed this item. 


Using mothers who were gainfully 
employed (i.e n excluding bouse- 
wives, mothers in school, pensioned, 
or deceased), a mean was calculated 
for each sample achooL Weights 
applied were identical to those used 
in FOCC 


A school high on this index draws 
a greater proportion of its students 
frem homes in which the working 
mothers are more likely to he em- 
ployed in highertpayin£ johs and/ 
or johs requiring a higher educa- 
tional level. 




PCTMW 
(Percentage 
of mothers 
working) 


From the sample student’s report of 
MOCC, the percentage of working 
mothers was calculated. 




This score reflects the percentage of 
working mothers. 


Background 


FAMSES 

(Family 

socioeconomic 

status) 


The family socioeconomic status for 
a school was calculated hy the for* 
mula: 

(1* FOCC for n t fathers 4- 2 MOCC 
for m mothers) 




This index ia a compoaite of MOCC 
and FOCC levels of the school. 






greater of n* and n 3 






1 


MEDUC 

(Mother’s 

education) 


The sample 11th grade student re* 
ported, the highest level of formal 
education attained hy his mother or 
female guardian. On the elementary 
level the student's teacher completed 
this item. 


The same weighting system was used 
as for TMEDUC. 


A higher value on this index indi- 
cates that the school draws students 
from homes in which the mothers 
have attained a higher average level 
of formal education. 




FEDUC 
1 ( Father’s 
| education) 


The student reported the highest 
level, of formal education attained 
hy his father or male guardian. On 
the elementary level the student's 
teacher completed this item. 


The same weighting system was used 
as for TMEDUC. 


A higher value on this index indi- 
cates that the school draws students 
from homes in which the fathers 
have attained a higher average level 
of formal education* 




SEX 
(Sex of 
students) 


The sample student reported bis or 
her sex. 


2 r Female 
1 s Male 


A higher value on this index repre- 
sents a higher proportion of female 
students. 


j Demographic 


RACE 
(Predicted 
achievement 
index hy race) 


From a list of six ethnic and racial 
categories each sample student chose 
the category that best described him. 


6 =: Oriental 

3 ss White 

4 =: American Indian 
3 ss Puerto Rican 

2 ss Black 
I as Other 


This variable was scaled in such a 
way that the index is a predicted- 
achievement index hy racial compo- 
sition. Weights were assigned ou 
the basis of the groups’ rank-order 
achieved scores as reported by Cole- 
man. 




ATTEND 

(Attendance) 


The sample student reported the 
number of days he was absent dur* 
ing the past school year. 


a ss None 
4 as 1*5 days 
3 as 6*10 days 
2 as 11*15 daya 
1 as 16 or more daya 


A higher value on this index repre- 
sents a greater degree of student 
attendance within the school. 
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HOW PREDICTIONS ARE MADE 

It must be remembered that although a school's standing on a condition variable might be 
of interest in itself, the primary purpose of collecting the information was to take into account 
those differences in school and community, instructional staff and students in a given school 
that delimit what a school can accomplish with its pupils and avoid the invidious comparisons 
that can occur when faced with only national norms-or even state norms-as a baseline of 
comparison for a school. 

The Regression Equation 

Using the correlations of condition variables to the goal scores and the correlations of 
condition variables to one another for Phase II data, it was possible to determine wha£ set of 
condition variables will best predict a school score on each goal. This technique of multiple 
regression analysis results in a regression equation for each goal. A predicted score is obtained 
by multiplying the school's standing on each of the condition variables which form the best 
set of predictors by predetermined weights and then adding a prediction constant. 1 " Since a 
predicted score is not 100 per cent accurate, a prediction band is calculated by adding and 
subtracting one standard error of estimate from the predicted school score. Thus even prior to 
administering the questionnaires for the 10 goals, by knowing a school's standing on the condition 
variables, one can then give a range into which one would expect the school to score. 

Schools Classified by Socioeconomic Status 

To derive the regression equation, 5th grade schools are first partitioned by socioeconomic 
status (SES) into three categories and designated High SES, Middle SES or Low SES. The 
classification is determined primarily by the school standing on the following set of variables: 
FEDUC, MEDUC, FOCC, MOCC, SUBSIDY, HOUSING. A graphic display of the school's rank 
on these variables is found on page 13 of each elementary school report. Factor scores [standard 
z-scores] were used to classify the schools as follows: 

High SES: Factor score greater than 0.3258 

Middle SES: Factor score between -0.4520 and 0.3258 inclusive 

Low SES: Factor score less than -0.4520 

[The cut-off points were selected to divide the Phase II elementary schools into three sets of 
equal number.] 



♦Predicted score = bjxj + b 2 X 2 + ... + b n x n + a 

Where bj = regression weight for a condition variable 

Xj = school score on the corresponding condition variable 
a = prediction constant 
n = number of variables used as predictors 

Prediction band = Predicted score ± standard error of estimate 22 



Separate Regressions 



For schools falling into the High SES category the set of condition variables which will 
best predict a score on Goal I is statistically selected. To each variable regression weights are 
assigned which will optimize the prediction on Goal I for all High SES schools. 

The procedure is reiterated for all remaining goal areas. The process is then repeated for 
all schools designated Middle SES and also Low SES. 

Table 9 displays the variables thus selected, the regression weights assigned,* the prediction 
constant to be added and the standard error of estimate. It also includes the proportion of variance 
accounted for uniquely (the square of the semipartial correlation coefficient) by each variable 
used in the prediction equation. 

Note on Teacher Salary 

Although average teacher salary is collected and reported for each school, TSALARY is 
excluded from the potential predictor set and hence is not allowed to enter any predictions. 
Other financial figures which also fluctuate from year to year have been standardized; but the 
unavailability of statewide salary data by building makes the adjustment for TSALARY impossible. 



Some Cautions 

The table which follows is included only to avoid the "black box ” syndrome. Multiple 
regression analysis is not magic. But it is open to grave misinterpretations. The reader must not 
isolate variables nor make cause-effect relationships. One variable may be a proxy for another 
because of the interrelationship (lack of independence) among condition variables. The statistically 
unsophisticated might better accept "on faith " the prediction process and forego any analysis 
lest misinterpretations arise. 



*The regression weights are to be multiplied by the raw score for the variable (as footnoted 
on page 18) except for the three financial variables SUBSIDY, INSEXADM, and EFFORT. 
Because of their year-to-year fluctuation, the raw scores are standardized before assigning 
regression weights. For these three variables the z-score must be multiplied by the regression 
weight. 



z-score = (District value) - (State Mean ! 

(Standard deviation) 

The state means and standard deviations for the variables are found at the bottom of Table 4. 
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GOAL I 7 : UNDERSTANDING OTHERS 
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GOAL VII : CREATIVITY 




GOAL IX: APPRECIATING HUMAN ACCOMPLISHMENT 
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STUDENT DISTRIBUTIONS 



A school mean alone disguises much about student performance on a given goal. Did all 
the students score close to the school mean or were the student scores widely divergent? Indeed, 
very different student distributions could result in similar mean scores. 

With this in mind, the student scores from the Phase II normative sample were rank-ordered 
high to low and divided into five as nearly equal categories as possible, representing the scores 
obtained by the top 20 per cent of the students in the state, the next 20 per cent, down to 
the lowest-scoring 20 per cent of students. I In many cases since a student score was a whole 
number, slightly more-or less-than 20 per cent of the students scored at the point or above 
and a 19, 21 or 22 may appear.] 

The chart below shows the form in which the distribution is reported for GOAL I, Self 
Understanding; 



GOAL SCORE 


* 


STATE NORM 


SCHOOL ACTUAL 


95 and Above 


* 


21% 


20% 


90-94 


* 


19% 


17% 


85-89 


* 


20% 


18% 


80-84 


* 


21% 


17% 


79 and Below 


* 


19% 


33% 



The left column shows the cut-off scores which come closest to dividing the student scores into 
quintiles-five equal categories. 

The middle column shows the exact percentages of students throughout the state whose 
scores placed them into each of these five categories. The School Actual column states the actual 
distribution of student scores for the given school. 



KEY ITEMS 



Statements that have a high itcm-to-total correlation or others of interest were selected from 
the goal instruments to suggest the type of items that comprise the questionnaire and to reveal 
to school personnel exactly what student responses resulted in the school mean and student 
distribution.* 

One may have a personal criterion in mind as to how one would expect or desire students 
to reply to a given item. Moreover, to enable school personnel to compare the responses of their 
students to those throughout the state, the percentages stated under KEY ITEMS in the sample 
school report which follows represent the percentage responses over the entire state sample. 

For goal areas which are of particular interest to a school, student responses to all items 
are available at the EQA Bureau office. 





*Percentages may not total 100 because of rounding or because all students did not mark a valid 
response to that item. 
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SAMPLE SCHOOL REPORT 



The following pages replicate a school report. Pages 2 and 3 represent the results for a 
hypothetical Middle SES school with its important points noted. 

Pages 4-6 display the 38 condition variables that were collected and an acronym or 
abbreviation for each. In a typical school report the school mean is given for each variable along 
with its corresponding percentile rank and the number of people whose replies were used to 
obtain the data. 

Since the school mean score on some variables was obtained from pupil responses, for such 
variables, the itemized student replies are listed. The figures given here are the state percentages 
for the 20,000 students involved in the normative study. This allows anyone in an assessed school 
to compare its pupil responses with the state average. 

Pages 7-12 of each school report give the student distribution and key item responses for 
each school. Again, to accommodate those who want to compare the pupil responses on key 
items to those throughout the state, the key item percentages that follow are the state percentages 
from the normative study. 
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THE FOLLOWING STATEMENTS REFER TO ASPECTS 
OF ANY SCHOOL. PLEASE INDICATE WHAT EXTENT 
EACH OF THESE STATEMENTS DESCRIBES THE 
CLIMATE OF YOUR SCHOOL. 



PAGE 2 

USE PENCIL ONLY 



Almost Never ^ 



Infrequently 



Sometimes 
Frequently v 



Almost AlwaVa ^ ""l 



TSAT1SF i find my job very exciting and rewarding 

1 am just a cog in the machinery of this school 

I feel involved in a lot of activities that go on in this school 

I do things at school that I wouldn't do if it were up to me 

I really don't feel satisfied with a lot of things that go on in this school. 
I have a lot of influence with my colleagues on educational matters 






IN GENERAL, WHAT DO YOU FEEL IS THE RELATIVE 
INFLUENCE EACH OF THE FOLLOWING GROUPS OR 
PERSONS HAVE ON EDUCATIONAL MATTERS IN 
YOUR SCHOOL? 



A great deal 



Considerable 



-Soma. 



Little, 



None 



HOW MUCH RELATIVE INFLUENCE DO YOU THINK 
THESE GROUPS OR PERSONS OUGHT TO HAVE IN 
DETERMINING EDUCATIONAL MATTERS IN YOUR 
SCHOOL? 



_A_jrjot_dajl 
Con«ldarabl6 *1 



Little 
Mona I 



Sorjja^ 1 



DISCREP 



The local school board 

Your superintendent 

Tho principal of your school 

You yourself 

A small group of teachers 

Teachers in general 

Curriculum personnel (supervisor, director or coordinator) . 

Students 

Parents . 

Teacher organizations. 

Local colleges 

Guidance and psychological personnel 

Newspapers 

P.T.A. (Parent -Teacher Association). 



HERE IS A LIST OF SOME CLASSROOM TEACHING 
PRACTICES. FOR EACH PRACTICE CHECK THE 
APPROPRIATE COLUMN AS IT PERTAINS TO YOU. 



Am using It regularly 
Use It occa sionally^ \ 



Have considered trying 
Hava navef tried lt_^ l 



Don’t agree with the practice 



1 



CLPRACT 



Id 

O 

< 

Q. 



td 

o 

(d 

o 



Pupil participation in lesson planning 

Pupil participation in classroom teaching 

Having pupils work in small learning teams. . . . . . 

Role playing (acting out situations) 

Use of games to aid learning 

Pupil evaluation of classroom climate 

Pupil participation in developing classroom rules. 

Involving pupils in community projects 

Utilizing local citizens as resource personnel ... 

Pupils as helpers or tutors of other pupils 

Others 
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SCHOOL INFORMATION 

PHASE III - QUALITY ASSESSMENT PROGRAM 



DEBE-401 (6/72) 



OATC 



INSTRUCTIONS: The questions which follow refer to the particular school which is participating in Phase III of the Quality Assessment 
Program. The name and number of the school appear below. Please answer the questions as accurately as you can since the accuracy of 
these answers is of utmost importance to your school’s assessment program. Mark your answers as shown in examples. 

Examples: If answer is 5 - d 0 1 0 10 1 5~l lf answer is 53 = 1 0 1 0 | 5 1 3 1 1 f answer is 504 = I 0 I S lo M I 



NAME OF SCHOOL 


SCHOOL DISTRICT 


SCHOOL POSITION OK PERSON 


SCHOOL EQA 






FILLING OUT THIS FORM 


number ] 




I 


l 


(1-3) j 

1 i 



I. The number of staff personnel who spend at least one half their time in instructional activity in the school. 



STAFFP 



(4 - 6) 



2. Total enrollment of the school as of October 1 , 1972. 



ENROLL 



□I 



3 . Number of library books which are available for student checkout. If a bookmobile serves the school* use the gQQKSp \ 

total books available at the building in a school year and place a check here < ). ' 



"1 i 



III • 15) 



4 . Sum of hours worked in the school per week by all nonorofess ional teacher aides including secretaries 
assigned to teaching staff and personnel whose primary function is to aid classroom teachers. 



M6 • 18) 



s. 



Approximately 
what percentage 
ol the lesidenccs 
m the area served 
by your school are 
best described 
as: 



a. Expensive private homes 






" 3 ' 

U 



119- 2 1) 



b. Moderate priced homes 



ci 



I 






c. Low cost homes 



d. Nigh rental apartments 



HOUSING 1 I ' 1 1 

Uh-?.7» 

i 



rm 



I2B - 30) $ 



c. Moderate rental apartments 



□m i 



IJI - 33) 



f. Low rental apartments 



rm i 



(34 - 30) 



FOR USE BY HIGH SCHOOLS ONLY 



6 * Number of personnel who spend at least SO per cent of their time as guidance counselors* i.e., personnel 
whose specific duties are those of counseling and advising students. 



GUIDANCE [ 1 1 



•:»7 - 38) 



7 , Holding power of this high school, record as per cent to one decimal place. 

Graduating Class of 1972+ Transfers ~ New Students 



HOLDING. !" I l~ 1 



(30 - 4 1) 



10th Grade Enrollment* September, 1969 

Transfers refers to those students who left school after beginning 10th grade to attend another school* including 
full-time, vocational students* Also include as transfers all students beginning 10th grade who have died* have 
become physically or mentally incapacitated or committed to a correctional institution. (Refer to DEBE-482, 
Summary of Annual Attendance Report, Item 21, Withdrawals, Wj to W s inclusive, W 9 , Wjq, Wjj, and W j4 .) 
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CHEC 


EVERY GRADE LEVEL HOUSED IN SCHOOL BUILDING 


K _ 


1 


2 


3 


A 


5 


6 


7 


8 


9 


10 


II 


12 


Nongraded 


Special Ed, 

































(42) (43) (44) (45) (46) (42) (48) (49) (50) (SI) (52) (S3) (54) (55) 



ERE IS A LIST OF SOME RELATIVELY NEW EDUCATIONAL PRAC- 
ICES. FOR EACH PRACTICE CHECK THE APPROPRIATE BLOCK AS 
' PERTAINS TO THE PARTICIPATING SCHOOL 


HAVE NEVER 
TRIEO IT 


DON'T AGREE 
WITH THE 
PRACTICE 


HAVE 

CONSIDERED 
TRYING IT 


USE IT 
OCCASION- 
ALLY 


AM USING 
IT 

REGULARLY 


INNOVATE 


1 


2 


3 


A 


s 


. INDEPENDENT STUDY. Regularly scheduled work by individual 
pupils with a minimum of teacher direction (57) 












. NONGRADED CLASSES* Pupils are assigned to classes on the basis 
of ability without regard to traditional one-year steps ($0) 












. TEACHER AIDES* Regular employment of persons to assist Che teacher 
in the classroom in administrative and other nonteaching functions (59) 












. LAV READERS* Regular employment of persons to assist the teacher 
in reading and grading the written work of pupils (60) 












- PROGRAMMED INSTRUCTION. The use of educational material so 
designed rhat each pupil works at his own pace through sequential 
steps, receiving Immediate Indication of the correctness of response 
he has given to programmed questions. May or may not involve 
mechanical devices or "machines" (61) 












WORK EXPERIENCE PROGRAMS. Programs In which students* while 
in school or on vacation* undortake employment undor school guidance 
directly related to their educational courses (62) 












INSTRUCT IONAL TELEVISION. Regularly scheduled in-class viewing 
*>1 televised instruction coordinated with instruction on the same 
material by tie classroom teacher (63) 












^ L LXlBLE SCHEDULING. Situation In which class size* length of 
class meetings, number and spacing of classes are varied according to 
an assessment of the nature of the subject* type of Instruction and 
abin’v and Interest of students (64) 












STUDENT TUTORING PROGRAM. Students who excel in a given 
subj# a area volunteer to help students having difficulty In that 
aita (65) 












LANGUAGE LABORATORY. Audio equipment arranged to permit 
mdi\ idual members of a class to hear speech, practice speaking and 
hear play back (66) 












OTHER (SPECIFY). 

(67) 
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DEPARTMENTALIZATION 

(68) 













Doer vour school have the services of a guidance counselor assigned specifically to the elementary school program on s regular basis? (69) 

«)□ Yes ’ (I) O No 
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Insexadm Subsidy Effort 
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(70-72) 



(73-7S) 



(76*78) 









APPENDIX C 

LIST OF OCCUPATIONS FOR FOCC AND MOCC 



LIST OF OCCUPATIONS 



HEALTH SERVICES 



TRANSPORTATION 



SALES WORKERS 



001 Dentist 

002 Physician, Osteopath, or Surgeon 

003 Pharmacist 

004 Optometrist or Chiropractor 

005 Veterinarian 

006 Medical or Dental Technician 

007 Nurse 

008 Practical Nurse 

009 Hospital Attendant 



EDUCATION 



050 Pilot 

051 Manager, Owner, or Official 

052 Locomotive Engineer 

053 Railroad Conductor 

054 Locomotive Fireman 

055 Railroad Brakeman or Switchman 

056 Inspector of Vehicles 

057 Dispatcher 

058 Deliveryman 

059 Bus Diiver 

060 Shipping Clerk 

061 Truck Driver 

062 Taxi Driver 

063 Laborer 



102 Stock Broker 

103 Advertising Agent 

104 Insurance Agent 

105 Industrial Sales Worker 

106 Real Estate Agent 

107 Wholesale Trade Sales Worker 

108 Retail Trade Sales Worker 



BUSINESS OTHER THAN SALES 



010 Administrator 

011 Teacher or Instructor 

012 Librarian 

013 Library Assistant or Teacher Aide 



COMMUNICATION OR PUBLIC 
UTILITY 



INDUSTRY FACTORY 



014 Industrial Foreman 

015 Toolmaker 

016 Stationary Engineer 

017 Metal Worker 

018 Machinist 

019 Millwright 

020 Jobsetter 

021 Wilder or Flame-Cutter 

022 Metal Filer, Grinder, or Polisher 

023 Craneman, Derrickman, or Hoistman 

024 Furnaceman, Smelterman, or Pourer 

025 Operator of Industrial Equipment 

026 Operator in Laundry 

027 Metal Moldet 

028 Quarry Worker 

029 Packer, Wrapper, or Grader 

030 Laborer 



064 Editor, Reporter, or Author 

065 Manager, Owner, or Official 

066 Technician 

067 Postmaster 

068 Foreman 

069 Lineman or Serviceman 

070 Telephone or Telegraph Operator 

071 Laborer 



SERVICE WORKERS 



072 Printing Craftsman 

073 Decorator 

074 Policeman or Detective 

075 Fire Fighter 

076 Appliance/Office Machine Repairman 

077 Butcher 

078 Mechanic 

079 Tailor 

080 Baker 

081 Equipment Maintenance Man 

082 Service Station Attendant 



109 Personnel Worker 

110 Accountant or Auditor 

111 Buyer or Purchasing Agent 

112 Credit Man 

Manager, Owner, or Official 

113 of a Bank or F induce Institution 

114 of an Insurance Company 

115 of a Real Estate Agency 

116 of an Industry 

117 of a Wholesale Trade 

118 of a Cai Dealership 

119 of a Department, Clothing or 
Furniture Store 

120 of a Hardware, Implement or 
Building Material Supplier 

121 of a Food Store 

122 of an Eating Place or 
Drinking Place 

123 of 3 Repair Service 

124 of a Service Station 

125 of a Junkyard 



OTHER PROFESSIONAL AND 
TECHNICAL WORKERS 



031 


Textile Spinner or Weaver 


084 


Watchman or Guard 


126 


Lawyer or Judge 




032 


Moiorman 


085 


Barber or Beautician 


127 


Engineer 




033 


Miner 


086 


Waiter, Waitress, or Bartender 


128 


Social Scientist 
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087 


Cook 


129 


Natural Scientist 








088 


Janitor or Cleaning Woman 


130 


Draftsman or Artist 


\ 

s 






089 


Sanitation Worker 


131 


Social Worker 


i 


CONSTRUCTION 






132 


Undertaker 


j 


034 


Architect 


AGRICULTURE 


133 

134 


Clergyman 

Musician or Entertainer 


-j 


035 


Manager, Owner, or Official 


090 


Landscaper or Tree Surgeon 


135 


Photographer 
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036 


Electrician 


091 


Farm Manager 


136 


Surveyor 


i 


037 


Foreman 


092 


Farmer 


137 


Dietitian 




038 


Plumber 


093 


Laborer 








039 


Brickmason, Tilesetter, or Glazier 













040 Plasterer 

041 Stone Mason, Cutter or Carver 

042 Heavy Equipment Operator 

043 Cabinetmaker 

044 Carpenter 

045 Painter 

046 Roofer 

047 Paperhangcr, Carpet or Tile Layer 

048 Laborer 

049 Lumberman 



CLERICAL WORKERS 



094 Stenographer; Typist, or Secretary 

095 Mail Carrier or Clerk 

096 Bank Teller 

097 Bookkeeper 

098 Office Machine Operator 

099 Cashier or Office Clerk 

100 Collector 

101 Messenger 



SPECIAL 



200 Housewife 

300 Unemployed 

400 Pensioned 

500 Student 

600 Not Living at Home 

700 Deceased 
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